The Ising model on a brain network maximizes Information Transfer at criticality 
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We implement the Ising model on a structural connectivity matrix describing the brain at a coarse 
scale. Tuning the model temperature to its critical value, i.e. at the susceptibility peak, we find 
a maximal amount of total information transfer between the spin variables. At this point, the net 
dynamics exhibits signature of the law of diminishing marginal returns, an economics constraint that 
states that at saturation levels of production, to increase the total output is not possible to increase 
only one production factor, but all of them have to be increased. Our results extend the recent 
analysis of dynamical oscillators models on the connectome structure, taking into account lagged 
and directional influences, focusing only on the nodes that are more prone to became bottlenecks 
of information. The ratio between the outgoing and the incoming information at each node, is 
related to the instrength, it nevertheless seem to capture also diflferent aspects of important nodes 
in weighted brain networks. 

PACS numbers: 05.50.+q,87.19.L- 



Methods of complex networks theory are becoming 
more and more popular in ncuroscience []|. Moreover, 
the inference of the underlying network structure of com- 
plex systems [2], from time series data, is an important 
problem that received great attention in the last years, 
in particular for studies of brain connectivity in neuro- 
science [^-Q- This problem can be handled by estimat- 
ing, from data, the flow of information between variables, 
as measured by the transfer entropy 0, Q ■ Recently 
it has been shown that transfer entropy is strongly re- 
lated to Granger causality 10], a major tool to reveal 
drive-response relationships among variables. 



In a recent paper llj it has been shown that the pat- 
tern of information flow among variables of a complex 
system is the result of the interplay between the topology 
of the underlying network and the capacity of nodes to 
handle the incoming information, and that, under suit- 
able conditions, it may exhibit the law of diminishing 
marginal returns 12|, a fundamental principle of eco- 



nomics which states that when the amount of a variable 
resource is increased, while other resources are kept fixed, 
the resulting change in the output will eventually dimin- 
ish. The origin of such behavior resides in the structural 
constraint related to the fact that each node of the net- 
work may handle a limited amount of information. In 
[ill] the information flow pattern of several dynamical 
models on hierarchical networks has been considered and 
found to be characterized by an exponential distribution 
of the incoming information and a fat-tailed distribution 
of the outgoing information, a clear signature of the law 
of diminishing marginal returns. 

Motivated by the evidence that brain function resides 



in its ability to process and store information, and by 
the fact that brain dynamics is associated to criticality 
[isl - fisj , here we consider an anatomical connectivity ma- 
trix (66 nodes), obtained via diffusion spectrum imaging 
(DSI) and white matter tractography describing the 
brain at a coarse scale, and implement on it an Ising 
model with Glauber dynamics, estimating numerically 
the information transfer between spins. Varying the tem- 
perature, the susceptibility shows a peak which is related 
to a phase transition occurring in the limit of large net- 
works T7], characterized by long range correlations; al- 
though we are dealing with a network of small size, we 
will refer to the temperature at the peak of % as the crit- 
ical state of the system. We find that at criticality, the 
Ising model is characterized by the maximal amount of 
total information transfer among variables and exhibits 
signature of the law of diminishing marginal returns. The 
modulation of this phenomenon is analyzed evaluating, 
at each node, the ratio r between the outgoing and the 
incoming information. It turns out that r is related to 
(but not fully explained by) the in-strength of the brain 
network: nodes with high r are those more prone to be- 
come bottlenecks as the information flow increases. 

The couplings of the Ising model are Jij = §Aij , where 



A is the anatomical connectivity matrix. In 11| just the 
diluted Ising model has been studied; here we analyze 
Ising models on the structural architecture of the brain, 
characterized by two modules corresponding to the two 
hemispheres. Since it has been shown that for Ising mod- 
els Granger causality provides a good approximation to 
the transfer entropy while being computationally much 
more efficient llSlI , here we estimate information flows in 
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terms of the Granger causality; in other words, we adopt 
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FIG. 1: Concerning tlie Ising model on the brain network, 
the following quantities are depicted versus the temperature 
p-. R, the ratio between the standard deviations of outgoing 
and incoming information flows ; the total causality C, i.e. the 
sum of all information flows in the network; the susceptibility 
X- AH quantities have been normalized in the interval [0,1]. 
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FIG. 2: Concerning the Ising model on the brain network, 
the ratio S between the intra-hemispheres and the inter- 
hemispheres information flows, measuring the segregation of 
the network, is plotted. 

In figure ([T]) we depict three quantities as a function 
of the inverse temperature /3: (1) the ratio between the 
standard deviation of the distributions of the outgoing 



FIG. 3: Concerning the linear model with threshold on the 
brain network, the following quantities are depicted versus the 
threshold 6: R, the ratio between the standard deviations of 
outgoing and incoming information flows ; the total causality 
C, i.e. the sum of all information flows in the network ; the 
susceptibility x- AH quantities have been normalized in the 
interval [0,11. 



information and the incoming information 



R = 



where c is the information flow estimated by Granger 
causality. R is an indicator for the law of diminishing 
marginal returns, and is a quantity calculated in this 
case at a global level, pooling all the nodes together, 
unlike r which is a local measure; (2) the sum C of 
all the information transfers between spins, quantifying 
the circulation of information in the network; (3) the 
susceptibility x-, whose peak corresponds to criticality 
(pseudo-transition). We find that the critical state of 
the Ising model is also characterized by having the max- 
imal amount of total flow of information, and by the fact 
that some units are close to be receiving the maximal 
amount of input information. In figure © the ratio S 
between the intra-hemisphere information flow and the 
inter-hemispheres information flow, measuring the segre- 
gation of the network, is depicted; as the temperature is 
lowered (/? is increased), the hemispheres become more 
and more segregated. 

In figure ^ we plot the same quantities as in figure 
^ for a linear model with threshold introduced in ll|, 
as the threshold 9 is varied. The model has been imple- 
mented on the 66 nodes brain network, the susceptibility 
being evaluated as the variance of mean population ac- 
tivity. In this case the peak of the susceptibility does 
not correspond to the peak of C: the characterization of 
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the critical state as those with the maximal information 
transfer, which holds for the Ising model, is only approx- 
imately true for this model. Also the law of diminishing 
marginal returns is mostly evident at lower values of 6. 

The modulation of the law of diminishing marginal re- 
turns can be analyzed evaluating, at each node, the ra- 
tio between the outgoing and the incoming information. 
Figure (|H) refers to the value of /3 leading to the maxi- 



r and the instrength. Fig. (|4]) suggests that whilst other 
network properties related with "hubness" such as effi- 
ciency and betweenness did not correlated with the in- 
strengh, we have found a clear correlation between the r 
value in each node for both Ising and LwT models, thus 
suggesting that, independently on model details, these 
two measures are strongly related. 
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FIG. 4: The patterns of r, for the Ising model and for the lin- 
ear model with threshold described in are shown and com- 
pared with the in-strength, i.e. the indegree in the weighted 
connectivity matrix Aij, the efficiency and the betweeness of 
nodes [? ]. The values of r have been normalized to the 
interval [0,1]. Nodes are ordered according to increasing in- 
strength. Note that r is not fully explained by the in-strength, 
there are node with intermediate in-strength but with high r: 
the ratio r thus measures a property of nodes which is con- 
nected but not equivalent to the in-strength. 

mum of R, and describes, for each node, the ratio 

{Cout) 

r = 

{c-in ) 

compared with topological properties of the graph, 
such as the strength, the node-efficiency and the node- 
betweeness; nodes have been ordered according to grow- 
ing values of the in-strength. We also compare with 
the pattern of r's obtained using the linear model with 
threshold introduced in ll|: the threshold parameter in 
such model is tuned so as to maximize R. In figure ([5]) 
we plot r versus the in-strength, for the Ising model and 
for the linear model with threshold. We observe that r 
is only partially explained by the in-strength and it thus 
elicits an intrinsic property of nodes, the propensity to 
become bottlenecks of information. Remarkably, figure 
(3) also shows that r depends slightly on the dynamical 
model, the two models present high correlation between 



FIG. 5: The ratio between the outgoing and the incoming 
information at each node is depicted versus the in-strength of 
nodes, for the linear model with threshold (top) and for the 
Ising model (Bottom). Pearson linear correlations are 0.81 
(linear with threshold) and 0.69 (Ising). 
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FIG. 6: The value of r for each of the 66 regions for the linear 
model with threshold (top) and the Ising model (bottom). 
The size of the spheres is proportional to r. 

The regions which are recognized as potential bot- 
tlenecks by the present analysis are symmetrical in the 
two hemispheres, and are Superior Frontal Cortex, Pre- 
cuneus, Superior Temporal Cortex, Medial and Lateral 
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Orbitofrontal Cortex. Some of these regions are consid- 
ered as hubs both for the structural and for the functional 
connectome. It is worth to recall anyway that being a hub 
(in particular for incoming connections) does not neces- 
sary imply that a node is a bottleneck of information 
flow. 

Recent works 13, 15, 3"21| have simulated the spon- 
taneous brain activity implementing models of dynamical 
oscillators with different levels of complexity and biolog- 
ical foundation on the connectome structure, retrieving 
in some cases correlation-based networks similar to those 
observed from the analysis of neuroimaging data (mainly 
fMRI at rest). The present work extends the analysis 
to dynamical networks who take into account lagged and 
directional influences. We have shown that the critical 
state of the Ising model on a brain network is charac- 
terized by the maximal amount of information transfer 
among units and brain effective connectivity networks 
may also be considered in the light of the law of dimin- 
ishing marginal returns: some units more prominently 
express this disparity between incoming and outgoing in- 
formation and are thus liable to become bottlenecks of 
information. Comparing with a linear model with thresh- 
old, on the same network, we find that the characteriza- 
tion of the critical state as the maximizer of the total 
information transfer does not hold in this case hence it 
is not a generic property. Apart from the insights on 
how structure and dynamics interact to generate brain 
function, the approach here described could have more 
general implications revealing nodes of a network which 
are particularly representative [22*1 or influential for the 
others [H. 
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